Profit Sharing is one of the reinforcement learning methods. An agent, as a learner, selects an action with a state-action value and receives rewards when it reaches a goal state. Then it distributes receiving rewards to state-action values. This paper discusses how to set the initial value of a state-action value. A distribution function ƒ( x ) is called as the reinforcement function. On Profit Sharing, an agent learns a policy by distributing rewards with the reinforcement function. On Markov Decision (...) Processes (MDPs), the reinforcement function ƒ( x ) = 1/ L x is useful, and on Partially Observable Markov Decision Processes (POMDPs), ƒ( x ) = 1/ L w is useful, where L is the sufficient number of rules at each state, and W is the length of an episode. If episodes are always long, the value of the reinforcement function is little. So the differences of rule values become little, and the agent learns little by using the roulette selection as an action selection. This problem is called as Learning Speed Problem. If the value of the reinforcement function for an action is very higher than its state-action value, an agent will not select other action. There is a problem when its action is not a optimal action. This problem is called as Past Experiences Problem. This paper shows that both Learning Speed Problem and Past Experiences Problem are caused by the bad setting between the initial values of a state-action values and the function values of a reinforcement function. We propose how to set the initial values of a state-action values at each state. The experiment shows that an agent can learn correctly even if the length of episode is large. And shows the effectiveness on both MDPs and POMDPs. Our proposed method focuses on the initialization of state-action values and does not limit reinforcement functions. So it can apply to any reinforcement function. (shrink)

In this paper, we consider profit sharing that is one of the reinforcement learning methods. An agent learns a candidate solution of a problem from the reward that is received from the environment if and only if it reaches the destination state. A function that distributes the received reward to each action of the candidate solution is called the reinforcement function. On this learning system, the agent can reinforce the set of selected actions when it gets the reward. And the (...) agent should not reinforce the detour actions. First, we will propose a new constraint equation about reinforcement functions to distribute the reinforcement values on the non-detour actions. If we use the reinforcement function to satisfy the constraint equation, the agent can select the non-detour actions directing to the destination state. Next, it is shown that the reinforcement function can be constant after learning process to suppress the selection of detour actions. Lastly, in computer simulations for maze problems, we show that the learning performance of agents does not depend on the size of environment. (shrink)

IntroductionPrevious studies on metacognitive ability were explored using self-report questionnaires that are difficult to adequately measure and evaluate when the capacity for self-reference is undeveloped. This study aimed to validate the Congruency-based Metacognition Scale to measure metacognition and the feeling of confidence abilities and to investigate the development of metacognition during adolescence.MethodsThe CMS was administered to 633 child–parent pairs in Japan. The CMS metacognition score was assessed based on congruency scores between the self-report of the child from a third-person perspective (...) and the parent’s report from the first-person perspective. The CMS self-judgment accuracy score was assessed by the congruency scores between the children’s self-report from the 1PP and 3PP. For both measures, the more distant the 3PP on the self-report was from the 1PP on the parent’s report and child self-report means low ability. An exploratory factor analysis was conducted to examine construct validity and then a confirmatory factor analysis was used. Criterion validity was examined by calculating Pearson’s correlation coefficients with scores on the Beck Cognitive Insight Scale and Autism Quotient. We used intraclass correlation and Cronbach’s alpha to examine the test–retest and internal consistency reliability.ResultsBased on the results of the EFA and CFA, we adopted one factor structure with five items. The CMS metacognition and CMS self-judgment accuracy showed evidence criterion validity, exhibiting significant correlations with the BCIS self-reflectiveness and self-certainty scores, respectively. Regarding to the AQ, only the CMS metacognition score had significant correlations with the social skills and total scale score. The test–retest reliability showed adequate. Adolescents were found to have significantly lower metacognitive ability compared to young adults.ConclusionCMS could be a valid and reliable measure to examine metacognitive abilities for adolescents. (shrink)

The projection pattern of the existential/uniqueness presupposition of a wh-complement varies depending on the predicate that embeds it. This variation poses problems for existing accounts that treat the presupposition as a semantic contribution of an operator merging with the wh-complement or of the embedding predicate. I propose that the problems can be solved if the existential/uniqueness presupposition is contributed by the propositions corresponding to the answers of the embedded question, under the Hamblin/Karttunen semantics for questions.

The conflict between Platonic realism and Constructivism marks a watershed in philosophy of mathematics. Among other things, the controversy over the Axiom of Choice is typical of the conflict. Platonists accept the Axiom of Choice, which allows a set consisting of the members resulting from infinitely many arbitrary choices, while Constructivists reject the Axiom of Choice and confine themselves to sets consisting of effectively specifiable members. Indeed there are seemingly unpleasant consequences of the Axiom of Choice. The non-constructive nature of (...) the Axiom of Choice leads to the existence of non-Lebesgue measurable sets, which in turn yields the Banach-Tarski Paradox. But the Banach-Tarski Paradox is so called in the sense that it is a counter-intuitive theorem. To corroborate my view that mathematical truths are of non-constructive nature, I shall draw upon Gödel’s Incompleteness Theorems. This also shows the limitations inherent in formal methods. Indeed the Löwenheim-Skolem Theorem and the Skolem Paradox seem to pose a threat to Platonists. In this light, Quine/Putnam’s arguments come to take on a clear meaning. According to the model-theoretic arguments, the Axiom of Choice depends for its truth-value upon the model in which it is placed. In my view, however, this is another limitation inherent in formal methods, not a defect for Platonists. To see this, we shall examine how mathematical models have been developed in the actual practice of mathematics. I argue that most mathematicians accept the Axiom of Choice because the existence of non-Lebesgue measurable sets and the Well-Ordering of reals open the possibility of more fruitful mathematics. Finally, after responding to Benacerraf’s challenge to Platonism, I conclude that in mathematics, as distinct from natural sciences, there is a close connection between essence and existence. Actual mathematical theories are the parts of the maximally logically consistent theory that describes mathematical reality. (shrink)

Le présent article a pour but d’expliciter le caractère d’existence de la signification du point de vue de la sémantique. Il est ici prouvé que la signification ne peut être en tant que telle ni psychique, ni physique, ni même métaphysique, ce qui nous pousse à nous opposer à toutes les vues qui ont eu cours sur la signification. Car la signification consiste, en soi et pour soi, dans le rapport quadripartite...

Long before the origins of agriculture human ancestors had expanded across the globe into an immense variety of environments, from Australian deserts to Siberian tundra. Survival in these environments did not principally depend on genetic adaptations, but instead on evolved learning strategies that permitted the assembly of locally adaptive behavioral repertoires. To develop hypotheses about these learning strategies, we have modeled the evolution of learning strategies to assess what conditions and constraints favor which kinds of strategies. To build on prior (...) work, we focus on clarifying how spatial variability, temporal variability, and the number of cultural traits influence the evolution of four types of strategies: (1) individual learning, (2) unbiased social learning, (3) payoff-biased social learning, and (4) conformist transmission. Using a combination of analytic and simulation methods, we show that spatial—but not temporal—variation strongly favors the emergence of conformist transmission. This effect intensifies when migration rates are relatively high and individual learning is costly. We also show that increasing the number of cultural traits above two favors the evolution of conformist transmission, which suggests that the assumption of only two traits in many models has been conservative. We close by discussing how (1) spatial variability represents only one way of introducing the low-level, nonadaptive phenotypic trait variation that so favors conformist transmission, the other obvious way being learning errors, and (2) our findings apply to the evolution of conformist transmission in social interactions. Throughout we emphasize how our models generate empirical predictions suitable for laboratory testing. (shrink)

Humans have great locomotor adaptability to environmental demands, which has been investigated using a split-belt treadmill with belts on both the left and right sides. Thus far, neuromuscular control in split-belt locomotor adaptation has been evaluated by analyzing muscle activities at the individual muscle level. Meanwhile, in the motor control field, the muscle synergy concept has been proposed. Muscle synergies are considered the fundamental building blocks of movement and are groups of coactive muscles and time-varying activation patterns, thereby, reflecting the (...) neurophysiological characteristics of movement. To date, it remains unclear how such muscle synergies change during the adaptation and de-adaptation processes on the split-belt treadmill. Hence, we chronologically extracted muscle synergies while walking on the split-belt treadmill and examined changes in the number, muscle weightings, and temporal activation patterns of muscle synergies. Twelve healthy young males participated, and surface electromyography signals were recorded bilaterally from 13 lower-limb muscles. Muscle synergies were extracted by applying non-negative matrix factorization to the EMG data of each leg. We found that during split-belt walking, the number of synergies in the slow leg increased while an extra synergy appeared and disappeared in the fast leg. Additionally, the areas under the temporal activation patterns in several synergies in both legs decreased. When both belts returned to the same speed, a decrease in the number of synergies and an increase in the areas under the temporal activation patterns of several synergies were temporally shown in each leg. Subsequently, the number of synergies and the areas under the temporal activation patterns returned to those of normal walking before split-belt walking. Thus, changes in the number, muscle weightings, and temporal activation patterns of synergies were noted in the split-belt locomotor adaptation, suggesting that the adaptation and de-adaptation occurred at the muscle synergy level. (shrink)

The chapter contextualizes and reconstructs Walther’s theory of social acts. In her view a given act qualifies as social if it is performed in the name of or on behalf of a community. Interestingly, Walther’s understanding of that notion is patently at odds with the idea of a social act originally propounded by Reinach. According to Reinach, an act is social if it “addresses” other persons and if it, for its success, requires them to grasp it. We claim that to (...) explain Walther’s reconfiguration of this concept, one has to look into the use that Husserl makes of it. Husserl adopts this idea from Reinach to tackle a problem that is not discussed by the latter. This is the problem of how communities, by means of social acts, are “constituted” in consciousness. Walther shares with Husserl the concern about the constitution of communities and her radical revision of Reinach’s idea is presented as an attempt to offer an alternative solution to Husserl’s problem. (shrink)

This article offers a new interpretation of Plato’s method of collection and division as formulated in the Phaedrus, in light of a detailed examination of the surrounding context. It argues that Socrates carefully distinguishes the characteristic operations of the method from its applications. It shows that collection and division are to be construed independently of one another, and that the collection of F-ness is equivalent to the procedure for the definition of F-ness; and it clarifies three kinds of application that (...) are mentioned in the Phaedrus: simple definition, definition supplemented with division, and scientific analysis. (shrink)

Der Lehrstuhl für Christentumswissenschaft (Kirisutokyōgaku) an der Kaiserlichen Universität Kyoto wurde 1922 als Stiftungslehrstuhl gegründet. Die Gründung der Christentumswissenschaft in Kyoto erfolgte in einer spezifischen bildungspolitischen Konstellation: Es ging um die spannungsreichen Beziehung zwischen staatlichen Hochschulen und den Religionsgemeinschaften sowie um die Ansprüche einer dezidiert nationalen Politik. Der erste Inhaber des Lehrstuhls war einer der prominentesten japanischen Ideenhistoriker und Philosophen, Seiichi Hatano (1877–1950). Für Hatano gab es keinen Unterschied zwischen Theologie und Christentumswissenschaft. Er wandte die historische Methode auf die Forschung (...) zum frühen Christentum an, die er von deutschen Theologen gelernt hatte. Besonders stark hatte ihn die Religionsgeschichtliche Schule beeinflusst. Als Philosoph entwickelte Hatano eine Religionsphilosophie, die auf der Idee der Persönlichkeit basierte. Das starke Interesse am Thema “Persönlichkeit” hatte er auch mit den deutschen Theologen gemeinsam. Andererseits kritisierte Hatano den liberalen Protestantismus in Deutschland scharf. Dennoch wurde seine Haltung, mit der er die Vorgänger und Zeitgenossen “voraussetzungslos” kritisiert hatte, von führenden Vertretern des liberalen Protestantismus in Deutschland angenommen. (shrink)

Der Lehrstuhl für Christentumswissenschaft (Kirisutokyōgaku) an der Kaiserlichen Universität Kyoto wurde 1922 als Stiftungslehrstuhl gegründet. Die Gründung der Christentumswissenschaft in Kyoto erfolgte in einer spezifischen bildungspolitischen Konstellation: Es ging um die spannungsreichen Beziehung zwischen staatlichen Hochschulen und den Religionsgemeinschaften sowie um die Ansprüche einer dezidiert nationalen Politik. Der erste Inhaber des Lehrstuhls war einer der prominentesten japanischen Ideenhistoriker und Philosophen, Seiichi Hatano (1877–1950). Für Hatano gab es keinen Unterschied zwischen Theologie und Christentumswissenschaft. Er wandte die historische Methode auf die Forschung (...) zum frühen Christentum an, die er von deutschen Theologen gelernt hatte. Besonders stark hatte ihn die Religionsgeschichtliche Schule beeinflusst. Als Philosoph entwickelte Hatano eine Religionsphilosophie, die auf der Idee der Persönlichkeit basierte. Das starke Interesse am Thema “Persönlichkeit” hatte er auch mit den deutschen Theologen gemeinsam. Andererseits kritisierte Hatano den liberalen Protestantismus in Deutschland scharf. Dennoch wurde seine Haltung, mit der er die Vorgänger und Zeitgenossen “voraussetzungslos” kritisiert hatte, von führenden Vertretern des liberalen Protestantismus in Deutschland angenommen. (shrink)

Si pretendemos interpretar el significado de “Bu” con el pensamiento y las ideas actuales, dicha letra representaría el concepto de violencia, de la magnitud de una masacre. Esto es algo similar a la ficción que supone la tecnología que Winston-Churchill, narra en su obra sobre la Crisis Mundial, donde una sola llamada de teléfono podía hacer que miles de soldados mujeres y niños murieran, empujando de este modo a la humanidad al borde de la extinción. La Constitución de Japón, que (...) proclama la amenaza permanente de “La intimidación o el uso de la fuerza”, ilustra claramente este razonamiento. Nuestra guerra moderna en realidad implica poco más que derrotar la tecnología enemiga pero, el concepto que encierra la letra “Bu” no es tan mecánico ni superficial. (shrink)

Clause-embedding predicates come in three major varieties: responsive predicates are compatible with both declarative and interrogative complements; rogative predicates are only compatible with interrogative complements; and anti-rogative predicates are only compatible with declarative complements. It has been suggested that these selectional properties are at least partly semantic in nature. In particular, it has been proposed that the anti-rogativity of neg-raising predicates like believe comes from the triviality in meaning that would arise with interrogative complements. This paper puts forward a similar (...) semantic explanation for non-veridical preferential predicates such as hope, which are anti-rogative, unlike their veridical counterparts such as be happy, which are responsive. (shrink)

Why are diagrams sometimes so useful, while other times unhelpful and even misguiding? There are systematic reasons for this. Drawing on modern research in logic, Artificial Intelligence, cognitive psychology, and graphic design, "Semantic Properties of Diagrams and their Cognitive Potentials" shows that diagrams' cognitive functions are rooted in the characteristic ways they carry information about their targets. The analysis leads to an answer for the deeper question of What makes a diagram a diagram?, which is of crucial importance to the (...) foundation of a collective science of diagrams. ". (shrink)

We recently described a novel form of stress‐associated bidirectional plasticity at GABA synapses onto hypothalamic parvocellular neuroendocrine cells (PNCs), the apex of the hypothalamus‐pituitary‐adrenal axis. This plasticity may contribute to neuroendocrine adaptation. However, this GABA synapse plasticity likely does not translate into a simple more and less of inhibition because the ionic driving force for Cl−, the primary charge carrier for GABAA receptors, is dynamic. Specifically, stress impairs a Cl− extrusion mechanism in PNCs. This not only renders the steady‐state GABA (...) response less hyperpolarizing but also makes PNCs susceptible to the activity‐dependent accumulation of Cl−. Accordingly, GABA synapse plasticity impacts both the robustness of GABA voltage response and dynamic Cl− loading, imposing nonlinear influences on PNC excitability during circuit activities. This theoretical consideration predicts roles for GABA transmission far more versatile than canonical inhibition. We propose potential impacts of GABA synapse plasticity on the experience‐dependent fine‐tuning of neuroendocrine stress responses. (shrink)

No laws or official guidelines govern medical assistance for dying in Japan. However, over the past several years, cases of assisted suicide or voluntary euthanasia, rarely disclosed until recently, have occurred in close succession. Inspired by these events, ethical, legal, and social debates on a patient’s right to die have arisen in Japan, as it has in many other countries. Several surveys of Japanese people’s attitudes towards voluntary assisted dying suggest that a certain number of Japanese prefer active euthanasia. Against (...) this background, it is important to discuss voluntary assisted dying cases in Japan and the Japanese views on them and to consider their implications. We review three recent Japanese voluntary assisted dying cases and discuss the various objections to voluntary assisted dying that have been published in response to these in various media outlets. Our counterarguments include the double suffering of people who are unable to give up their desire to die, individuality of death, variability of culture, problem of being an annoyance to (burden on) others, a slippery slope argument supporting voluntary assisted dying, and unfair claims about responsibility and excessive burden on people who are unable to give up their desire to die. We also point out the psychocultural and social problems in Japanese society that these objections reflect, and argue that voluntary assisted dying can be ethically acceptable under certain conditions. We conclude that Japanese society must change in order to enable those who sincerely wish to die to do so in a better way. (shrink)

We can easily discriminate self-produced from externally generated sensory signals. Recent studies suggest that the prediction of the sensory consequences of one’s own actions made by forward model can be used to attenuate the sensory effects of self-produced movements, thereby enabling a differentiation of the self-produced sensation from the externally generated one. The present study showed that attenuation of sensation occurred both when participants themselves performed a goal-directed action and when they observed experimenter performing the same action, although they clearly (...) reported that the tones were produced by other during action observation and by themselves during their own action. These results suggest that sensory prediction of action modulates ongoing auditory processing irrespective of who produces the sounds and that the explicit judgment of agency does not necessarily rely on the same mechanisms on which implicit perceptual measures such as sensory attenuation rely. (shrink)

Background A baby hatch called the “Stork’s Cradle” has been in place at Jikei Hospital in Kumamoto City, Japan, since May 10, 2007. Babyklappes were first established in Germany in 2000, and there are currently more than 90 locations. Attitudes regarding baby hatches are divided in Japan and neither opinions for nor against baby hatches have thus far been overwhelming. To consider the appropriateness of baby hatches, we present and examine the validity of each major objection to establishing baby hatches. (...) Discussion There are various objections to baby hatches as follows: It violates a child’s right to know the identity of his or her biological parents by allowing anonymous birth; it neglects fulfillment of the biological parents’ basic obligation to raise their child and its very availability induces abandonment of infants; some people abuse it for very selfish reasons; it cannot save babies’ lives; the rights of one parent can be ignored if the other surrenders a child without his or her consent; it puts a baby in medical jeopardy; and it has no clear legal basis. The authors would argue that there are many plausible refutations for each objection mainly based on priority of child’s right to life, pregnant women’s vulnerability and necessity of anonymity, social responsibility to protect and raise children, differences between dropping a child off at a baby hatch and child neglect, limited function of social childcare center, inevitability of abuse by a minority of people, necessary distinction between outcomes that occur only because baby hatches exist and those that occur regardless of their existence, important local direct and upmost measures for women in trouble, and difference between ambiguous legality and illegality. Summary We argue that a certain number of baby hatches should continue to be established as a last resort, in a form that can maintain anonymity if the parent dropping the child off so desires. It should be supported if it is initiated with good intentions; if the maximum possible effort is made at said facility to protect the interests, rights, and safety of the child; and if no clear evidence of harm exists. (shrink)

Objective:This study aimed to investigate the effect of robot-assisted gait training therapy combined with non-invasive brain stimulation on lower limb function in patients with stroke and spinal cord injury.Data sourcesPubMed, Cochrane Central Register of Controlled Trials, Ovid MEDLINE, and Web of Science were searched.Study selectionRandomized controlled trials published as of 3 March 2021. RCTs evaluating RAGT combined with NIBS, such as transcranial direct current stimulation and repetitive transcranial magnetic stimulation, for lower limb function and activities in patients with stroke and (...) SCI were included.Data extractionTwo reviewers independently screened the records, extracted the data, and assessed the risk of bias.Data synthesisA meta-analysis of five studies and risk of bias were conducted. Pooled estimates demonstrated that RAGT combined with NIBS significantly improved lower limb function [standardized mean difference = 0.52; 95% confidence interval = 0.06–0.99] but not lower limb activities. Subgroup analyses also failed to find a greater improvement in lower limb function of RAGT with tDCS compared to sham stimulation. No significant differences between participant characteristics or types of NIBS were observed.ConclusionThis meta-analysis demonstrated that RAGT therapy in combination with NIBS was effective in patients with stroke and SCI. However, a greater improvement in lower limb function and activities were not observed using RAGT with tDCS compared to sham stimulation. (shrink)

Reconsideration-proofness is a solution concept proposed by Kocherlakota :33–54, 1996) for infinite horizon single-player problems in which time inconsistency is important. Kocherlakota’s definition has a limitation: it is not applicable to environments with state variables. The limitation is important because many time-inconsistent problems have state variables. This paper displays a natural generalization of reconsideration-proofness to environments with state variables, and shows that it leads to nonexistence in three examples. Such nonexistence contrasts with the general existence theorem obtained in environments without (...) state variables in Kocherlakota. In the first two examples, existence can be recovered with a modification in the solution concept. In the last example, nonexistence occurs even with the modified solution concept. Insights about further research are derived from these nonexistence results. (shrink)

As the internet becomes the basic resource of information, not only texts but images retrieval systems have been appeared. However, many of those supply only a list of images, so we have to seek the expecting images one by one. Although, image labeling is one of the solutions of such a problem, various words are labeled to an image if the words are extracted from only one Web page. Therefore, this paper proposes an image clustering system that labels images by (...) words related to a search keyword. This relationships are measured by Web pages in WWW. By the experimental results, users were enabled to find the intended images more faster than the ordinal image search system. (shrink)

Objective—To demonstrate Japanese doctors' and nurses' attitudes towards and practices of voluntary euthanasia (VE) and to compare their attitudes and practices in this regard. Design—Postal survey, conducted between October and December 1999, using a self-administered questionnaire.Participants—All doctor members and nurse members of the Japanese Association of Palliative Medicine.Main outcome measure—Doctors' and nurses' attitude towards and practices of VE.Results—We received 366 completed questionnaires from 642 doctors surveyed (response rate, 58%) and 145 from 217 nurses surveyed (68%). A total of 54% (95% (...) confidence interval (CI): 49-59) of the responding doctors and 53% (CI: 45-61) of the responding nurses had been asked by patients to hasten death, of whom 5% (CI: 2-8) of the former and none of the latter had taken active steps to bring about death. Although 88% (CI: 83-92) of the doctors and 85% (CI: 77-93) of the nurses answered that a patient's request to hasten death can sometimes be rational, only 33% (CI: 28-38) and 23% (CI: 16-30) respectively regarded VE as ethically right and 22% (CI: 18-36) and 15% (CI: 8-20) respectively would practise VE if it were legal. Logistic regression model analysis showed that the respondents' profession was not a statistically independent factor predicting his or her response to any question regarding attitudes towards VE. Conclusions—A minority of responding doctors and nurses thought VE was ethically or legally acceptable. There seems no significant difference in attitudes towards VE between the doctors and nurses. However, only doctors had practised VE. (shrink)